Multi-frequency sensing system with improved smart glasses and devices

ABSTRACT

The systems and methods described relate to the concept that smart devices can be used to: sense various types of phenomena like sound, blue light exposure, RF and microwave radiation, and, in real-time, analyze, report and/or control outputs (e.g., displays or speakers). The systems are configurable and use standard computing devices, such as wearable electronics (e.g., smart glasses), tablet computers, and mobile phones to measure various frequency bands across multiple points, allowing a single user to visualize and/or adjust environmental conditions.

CLAIM OF PRIORITY

This application is a U.S. Continuation-In-Part Patent Application ofU.S. Non-Provisional patent application Ser. No. 16/847,101 filed onApr. 13, 2020, which is a U.S. Continuation-In-Part Patent Applicationof U.S. Non-Provisional patent application Ser. No. 16/421,141 filed onMay 23, 2019, which is a U.S. Continuation-In-Part Patent Application ofU.S. Non-Provisional patent application Ser. No. 16/155,919, filed Oct.10, 2018, which is a Continuation of U.S. Non-Provisional patentapplication Ser. No. 14/862,304, filed Sep. 23, 2015, which claimspriority from U.S. Patent Provisional Application No. 62/054,286, filedon Sep. 23, 2014, the contents of which are hereby fully incorporated byreference.

FIELD OF THE EMBODIMENTS

The invention and its embodiments relate to audio manipulation and soundmanagement systems, particularly for home audio systems, public addresssystems, sound reinforcement systems, vehicle audio systems, ultrasonictransducers, infrasonic transducers, electro-optical transducers,wearable devices (e.g., smart glasses), microwave transducers, andassociated software for these applications.

BACKGROUND OF THE EMBODIMENTS

Each year sound companies spend billions of dollars on audiotechnologies and audio research to find new ways to improve audioquality in performance settings. Very often sound systems are designedto be used in a specific environment. For example, in a vehicle orprivate room setting, audio manipulation and output quality techniquesand technologies are either prescriptive or adaptive—neither of whichrequire the need for audio engineering professionals. However, in othersituations such as at a concert venue, a wide array of audioprofessionals must be employed. This can include monitor engineers,system technicians, and front-of-house engineers. These professionalsoperate mixing consoles and audio control units to produce desirable,high-quality audio output.

Whether prescriptive or adaptive, manned or unmanned, perceived soundquality is a function of complex transducer-based technologies andacoustic treatment that are typically controlled, managed andmanipulated by humans, and/or audio software and hardware. As such, bothhuman and physical capital are required to produce first-rate soundquality. However, even when the necessary human and capital has beenspent, it can still be very difficult to effectively manage audiooutputs in real-time. This is due to improper calibrations of signalpropagation and signal degradation, as well as unwanted harmonics andsoundwave reflections.

Particularly in an outdoor setting, single-source sound systemstypically produce an intermittent mix of unintelligible sounds andechoes due to a given venue's size and openness. A popular solution foraddressing the echo issue is to utilize distributed sound systems.Traditional distributed sound systems are less susceptible to soundvariance than single source systems. However, even when thesedistributed systems are used, temperature gradients and wind can stillsteer sound in undesirable ways.

Another issue related to the size of a performance venue is when audioand video fall out of sync. As live musical performances become more andmore elaborate by including digital art and screens on-stage, it isbecoming increasingly difficult to reliably sync audio and video inlarge venues, due to highly reverberant surfaces and long decay times.

Also impacting audio intelligibility during a live performance is crowdnoise. At a live event, it is not uncommon for crowds to generate noiseapproaching 105 dB. When this occurs, audio engineers must manipulatethe supporting sound system output so that the performance audio remains5-8 decibels higher than the noise generated by crowd. This actionresults in performance sound being broadcast above 110 dB, the rangewhere the volume of sound begins to pose danger to human listeners.Frequently, audio system operators find it difficult to granularlycontrol the loud perception of a given individual listener whilemanaging loudness perception for the remainder of the audience. In acase where an audio quality trade-off decision has to be made, a commonindustry practice is to execute a remediation plan that favors themajority of listeners while the minority of listeners are forced tosuffer through it.

In other instances, when various pieces of audio equipment are slightly,or completely out-of-phase, it can be difficult for audio systemoperators to correct these out-of-phase issues in a short period oftime.

A myriad of audio functions are necessary to provide a dynamic range ofaudio playback and fidelity. To meet heightened demands and address newchallenges, the devices of today will not only have to handletraditional telephony voice communication and low-fidelity voicerecording, but also, these devices must be capable of incorporating newhardware and software to create new functions and applications such assensing infrasonic, ultrasonic, blue light and millimeter wave exposureand reporting, and in some cases, autonomous manipulation of audiooutputs. Further, such demands create the need to process signals using‘low-loss’ methods by moving much of the processing function away fromhardware and into software optimized to do so.

Further, very often, the general public associates hearing loss withloudness or volume but leaves little regard to pitch or frequency.Conductive, sensorineural, and mixed hearing loss (the three basic typesof hearing loss) are all extremely complex medical issues, and with eachcondition, loudness is only one of many contributory factors. Forexample, high-pitched sounds may damage the auditory nerve and haircells in the inner ear, which can result in sensorineural hearing loss,a type of hearing loss that cannot be ‘corrected’ using a hearing aiddevice. Understanding that there are limited treatment options for manyof the issues described (e.g. ‘profound’ sensorineural hearing loss thathas no cure), one function of this invention—and all related patents—isto use smart devices to mimic the way humans experience auditory,optical, and RF events in their respective micro and macro environments(clusters) in order to highlight dangers (when necessary), and providepreventative and customizable solutions.

Review of Related Technology

Line6, Inc. has created a ‘smart mixing system’ for non-wearableubiquitous computing devices that enables wireless and touchscreencontrol of live sound system components. This is accomplished via awired connection between standard audio hardware and a proprietaryphysical interface. While this system integrates and controls live soundsystem components via touchscreen devices, it unfortunately relies onaudio engineers to operate it, and does not incorporate alistener-centric way to autonomously solve audio issues experienced byan audience.

U.S. Pat. No. 5,668,884 pertains to an audio enhancement system andmethod of use with a sound system for producing primary sound from atleast one main loudspeaker located at a main position. The audioenhancement system comprises at least one wireless transmitter, timedelay circuitry, and plural augmented sound producing subsystems. Eachsound subsystem is a portable unit arranged to be carried by a personlocated remote from the main loudspeaker and includes a wirelessreceiver and an associated transducer device, e.g., a pair of stereoheadphones. The transmitter broadcasts an electrical signal which isrepresentative of the electrical input signal provided to the mainloudspeaker. The broadcast signal is received by the receiver and isdemodulated and amplified to drive the transducer so that it producesaugmented sound substantially in synchronism with the sound arrivingfrom the main loudspeaker. To achieve that end the time delay circuitrydelays the electrical signal which is provided to the transducer for apredetermined period of time corresponding generally to the time periodit takes for the primary sound to propagate through the air from themain loudspeaker to the remote location at which the person is located.

U.S. Pat. No. 7,991,171 pertains to a method and apparatus forprocessing an audio signal in multiple audio frequency bands whileminimizing undesirable changes in tonal qualities of the audio signal bydetermining an initial gain adjustment factor for each audio frequencyband resulting from the application of an audio processing technique. Afinal gain adjustment factor for each band is selected from acorresponding set of weighted or unweighted initial gain adjustmentfactors. The set of initial gain adjustment factors from which the finalgain adjustment factor for a specified audio frequency band is obtainedis derived from other audio frequency bands that have the frequency ofthe specified band as a harmonic frequency. Changes in audio signallevel within one audio frequency band thereby affect the signal level ofharmonic frequencies to decrease relative changes in volume between afundamental frequency and its harmonics.

U.S. Pat. No. 8,315,398 pertains to a method of adjusting a loudness ofan audio signal may include receiving an electronic audio signal andusing one or more processors to process at least one channel of theaudio signal to determine a loudness of a portion of the audio signal.This processing may include processing the channel with a plurality ofapproximation filters that can approximate a plurality of auditoryfilters that further approximate a human hearing system. In addition,the method may include computing at least one gain based at least inpart on the determined loudness to cause a loudness of the audio signalto remain substantially constant for a period of time. Moreover, themethod may include applying the gain to the electronic audio signal.

U.S. Pat. No. 8,452,432 pertains to a user-friendly system for real timeperformance and user modification of one or more previously recordedmusical compositions facilitates user involvement in the creativeprocess of a new composition that reflects the user's personal style andmusical tastes. Such a system may be implemented in a small portableelectronic device such as a handheld smartphone that includes a storedlibrary of musical material including original and alternative versionsof each of several different components of a common original musicalcomposition, and a graphic user interface that allows the user to selectat different times while that original composition is being performed,which versions of which components are to be incorporated to therebycreate in real time a new performance that includes elements of theoriginal performance, preferably enhanced at various times with userselected digital sound effects including stuttering and filtering. Thesystem may also optionally comprise a visualizer module that renders avisual animation that is responsive to at least the rhythm and amplitudeof the system's audio output, not only for entertainment value but alsoto provide visual feedback for the user.

U.S. Pat. No. 8,594,319 pertains to methods and apparatuses foradjusting audio content when more multiple audio objects are directedtoward a single audio output device. The amplitude, white noise content,and frequencies can be adjusted to enhance overall sound quality or makecontent of certain audio objects more intelligible. Audio objects areclassified by a class category, by which they can be assigned classspecific processing. Audio objects classes can also have a rank. Therank of an audio object's class is used to give priority to or applyspecific processing to audio objects in the presence of other audioobjects of different classes. United States Patent Publication No.2007/0217623 pertains to a real-time processing apparatus capable ofcontrolling power consumption without performing complex arithmeticprocessing and requiring a special memory resource. The real-timeprocessing apparatus includes an audio encoder that performs a signalprocessing in real time on an audio signal, a second audio encoder thatperforms the signal processing with a smaller throughput in real time onthe audio, an audio execution step number notification unit thatmeasures step number showing a level of the throughput in the signalprocessing by operating the 1st audio encoder or second audio encoder,and an audio visual system control unit that executes control so thatthe first audio encoder operates when the measured step number is lessthan a threshold value provided beforehand and the second audio encoderoperates when the step number is equal to or greater than the thresholdvalue.

United States Patent Publication No. 2011/0134278 pertains to animage/audio data sensing module incorporated in a case of an electronicapparatus. The image/audio data sensing module comprises: at least oneimage sensor, for sensing an image datum; a plurality of audio sensors,for sensing at least one audio datum; a processor, for processing theimage datum and the audio datum according to a control instruction setto generate a processed image data stream and at least one processedaudio data stream, and combining the processed image data stream and theprocessed audio data stream to generate an output data stream followinga transceiver interface standard; a transceiver interface, for receivingthe control instruction set and transmitting the output data stream viaa multiplexing process; and a circuit board, wherein the image sensor,the audio sensors and the transceiver interface are coupled to thecircuit board, and the processor is provided on the circuit board.

United States Patent Publication No. 2013/0044131 pertains to a methodfor revealing changes in settings of an analog control console, themethod comprising: receiving a captured image of the analog controlconsole; creating a composite image by superimposing the captured imageand a live image of the analog control console; and displaying thecomposite image.

United States Patent Publication No. 2013/0294618 pertains to a methodand devices of sound volume management and control in the attendedareas. According to the proposed method and system variants the soundreproducing system comprises: sounding mode appointment device, centralstation for audio signal transmittance; one or more peripheral stationsfor audio signal reception and playback; appliance for listener'slocation recognition; computing device for performing calculationconcerning sounding parameters at the points of each listener's locationand for performing calculation of controlling parameters for systemtuning. The system can be operated wirelessly and can compose a localnetwork.

WO 2016/180285 describes a wearable apparatus (e.g., a pair of smartglasses). The smart glasses comprise a glasses body composed of aglasses frame and lenses, and also comprise an image acquisition devicewhich is arranged on the glasses body and used for acquiring anenvironment image. The smart glasses also include a detection devicewhich is in communication connection with the image acquisition device.The detection device acquires the environment image and detects andextracts a human face image or/and a foreign language image. The smartglasses further include a recognition device which is in communicationconnection with the detection device and used for recognizing the humanface image or/and the foreign language image, so as to acquire identityinformation and native language information. The smart glasses alsoinclude an information output device which plays the identityinformation, the native language information, the identity informationor/and the native language information and at least one of the followingto a user: the human face image; the foreign language image; and theenvironment image.

KR 101816041 relates to smart glasses for storing a 3D model of a targetobject.

U.S. Pat. No. 9,955,286 describes a system for remote control ofwearable computers. The wearable computers may include smart glasses,augmented reality glasses, smart lenses, smart rings, and mobiledevices.

United States Published Patent Application No. 2016/0299569 describes apair of eyeglasses that has a frame and lenses mounted on the frame. Acomputer processor is mounted on eyeglasses together with a plurality ofcameras and a digital projection system. IR sensors and/or dual zoomcameras may also be mounted on the glasses and configured to track themovement of the user's hand.

Various devices are known in the art. However, their structure and meansof operation are substantially different from the present invention. Theinvention and its embodiments relate to audio manipulation and soundmanagement systems, particularly for home audio systems, public addresssystems, sound reinforcement systems, vehicle audio systems, ultrasonictransducers, infrasonic transducers, electro-optical transducers,wearable devices (e.g., smart glasses), microwave transducers, andassociated software for these applications.

SUMMARY OF THE EMBODIMENTS

The present invention and its embodiments relate to audio manipulationand sound management systems, particularly for home audio systems,public address systems, sound reinforcement systems, vehicle audiosystems, ultrasonic transducers, infrasonic transducers, electro-opticaltransducers, wearable devices (e.g., smart glasses), microwavetransducers, and associated software for these applications.

A first embodiment of the present invention provides a system. Thesystem includes an audio control source, or other data source capable ofprocessing sound fingerprint data, RF or optical data, or the like, andat least one cluster of at least one computing device. The at least onecomputing device includes a sound sensing mechanism configured to sensea noise and a wireless transceiver or wired data bus configured totransmit and receive data from the data source. The sound-sensingmechanism includes an omnidirectional transducer, an ultrasonictransducer, an infrasonic transducer, or a microwave transducer, amongother devices. The sensed noise includes infrasonic or ultrasonicsoundwaves.

The system also includes an in-ear device. In some examples, an audiooutput of the in-ear device may be configured to auto-adjust based onsignal energy sensed within a cluster of the at least one cluster orsurrounding clusters of the at least one cluster. In other examples, theaudio output of the in-ear device may be configured to manually adjust(e.g., is in a non-auto-adjust mode) based on the signal energy sensedwithin the cluster of the at least one cluster or the surroundingclusters of the at least one cluster.

Moreover, in some examples, a mobile cluster-based audio adjustingmethod and apparatus may be integrated with existing audio hardware andsoftware—such as the in-ear device. Key features of the mobilecluster-based audio adjusting method and apparatus include:user/listener-based sound management and control; a scalable platformthat can incorporate future technology—that is, new functionalities canbe added because the method and apparatus are designed to seamlesslyintegrate additional components including, but not limited to, softwareapplications such as a ‘sound preference’ application that setsuser-based sound perception settings on a mobile device or wearablecomputer; and autonomous audio sensing. The mobile cluster-based audioadjusting method and apparatus may also be configured, manufactured, andsold across different industries (e.g. automobile or audio electronicindustries).

In examples, the mobile cluster-based audio adjusting method andapparatus can be used in sound fingerprint and musicpublishing/performance applications. For example, the mobilecluster-based audio adjusting method and apparatus may be used in aperformance venue, where fingerprint data can be sent directly to musicpublishing entities from the described clusters. In another example, themobile cluster-based audio adjusting method and apparatus may interfacewith various communication offerings, such as e-mail, SMS, and visualscreens (for instance, communicative updates can be sent with sensedaudio measurements, and as a specific example, an SMS that reads a “tooloud in section A′/cluster A). Moreover, the mobile cluster-based audioadjusting method and apparatus can support a fixed or unfixed number of“sensing units.”

The at least one output device comprises a power source for operatingthe output device, a speaker for outputting sound and/or a display foroutputting visual data, and a communication mechanism for receivingelectronic information from the data source. The data source is inelectronic communication the at least one cluster and the at least oneoutput device. The data source comprises a memory and a processor. Thememory contains computer-executable instructions for connecting to theat least one cluster and varying an output of the at least one outputdevice (e.g. speaker or display unit). The processor executes thecomputer-executable instructions.

The computer-executable instructions include: identifying one or moresounds within the noise, isolating the one or more sounds, anddetermining if one or more of the one or more sounds includes afrequency outside of a predetermined threshold. The predeterminedthreshold equates to a frequency determined to pose a risk of harm to auser's hearing capabilities. If one or more of the one or more soundsincludes the frequency outside of the predetermined threshold, thecomputer-executable instructions further include: manually orautomatically altering the one or more of the one or more sounds so thatthe frequency does not fall outside of the predetermined threshold andoutputting the one or more sounds on the at least one output device.

The system further includes an interfacing mechanism. The interfacingmechanism includes a network adapter configured to transmit and receiveelectronic information through both wired and wireless communication andat least one input mechanism. The at least one input mechanism isconfigured to manipulate the interfacing mechanism and vary the outputof the at least one output device. The computer-executable instructionsfurther include panning the sensed noise and/or equalizing the sensednoise.

A second embodiment of the present invention describes a method ofaltering sensed noise prior to outputting the sensed noise. The methodincludes providing at least one data source and providing at least onecluster of at least one computing device. The at least one computingdevice includes a sound sensing mechanism configured to sense a noise, awireless transceiver or data bus configured to transmit and receive datafrom the data source, and at least one output device.

The at least one output device includes a power source for operating theoutput device, a speaker for outputting sound and/or a display foroutputting visual data, and a communication mechanism for receivingelectronic information from the data source. The data source is inelectronic communication the at least one cluster and the at least oneoutput device. The data source comprises a memory and a processor. Thememory contains computer-executable instructions for connecting to theat least one cluster and varying an output of the at least one outputdevice. The processor executes the computer-executable instructions.

The method further includes: identifying one or more sounds within thenoise, isolating the one or more sounds, and determining if one or moreof the one or more sounds includes a frequency outside of apredetermined threshold. The predetermined threshold equates to afrequency determined to pose a risk of harm to a user's hearingcapabilities. If one or more of the one or more sounds includes thefrequency outside of the predetermined threshold, the method furtherincludes manually or automatically altering the one or more of the oneor more sounds so that the frequency does not fall outside of thepredetermined threshold and outputting the one or more sounds on the atleast one output device. In some examples, the method further includes:panning the sensed noise, adding one or more audio effects to the sensednoise, and/or equalizing the sensed noise.

In examples, the at least one computing device further includes aninterfacing mechanism. The interfacing mechanism includes a networkadapter and at least one input mechanism. The network adapter isconfigured to transmit and receive electronic information through bothwired and wireless communication. The at least one input mechanism isconfigured to manipulate the interfacing mechanism and vary the outputof the at least one output device.

A third embodiment of the present invention describes a pair of smartglasses. The pair of smart glasses include: a first lens, a second lens,and a frame. Each of the first lens and the second lens include areplaceable prescription lens, a replaceable protective lens, areplaceable mixed-reality capable lens, a permanent prescription lens, apermanent protective lens, or a permanent mixed-reality capable lens,among other examples. In some examples, the frame comprises a materialhaving reflective wave characteristics to shield a head of a user fromunsafe frequencies.

The frame includes a first lens frame component configured to receivethe first lens, a second lens frame component configured to receive thesecond lens, and a bridge disposed between and configured to affix thefirst lens frame component to the second lens frame component. In someexamples, the pair of smart glasses also includes a charging portlocated at the bridge. The frame also includes a first temple affixed ata first location to the first lens frame component and a second templeaffixed at a second location to the second lens frame component. Thepair of smart glasses includes a first audio module located on aninterior of the first temple and a second audio module located on aninterior of the second temple.

The pair of smart glasses also includes a charging port located on therear side of the bridge. Moreover, the pair of smart glasses alsoincludes a module configured to detect one or more environmentalconditions. The module may include: a light sensing module located onthe front side of the bridge, an augmented reality display interfaceport located on the front side of the first lens frame component, afirst audio module located on the rear side of the first temple, and/ora second audio module located on the rear side of the second temple.Each condition of the one or more environmental conditions may include:artificial blue light, sounds above a predetermined threshold,millimeter waves, and/or ultrasonic waves, where the predeterminedthreshold is a frequency determined to pose a risk of harm to a user'shearing capabilities.

In some examples, the light sensing module is a light sensingtransducer. In other examples, the light sensing module is configuredto: scan an environment to detect environmental hazards and transmit anotification to a first in-ear device and a second in-ear deviceregarding the detected environmental hazards.

Moreover, the pair of smart glasses further includes a first wire and asecond wire, where each of the first wire and the second wire have afirst side disposed opposite a second side. The first side of the firstwire is affixed to the first location. The second side of the first wireis affixed to the first in-ear device. The first side of the second wireis affixed to the second location. The second side of the second wire isaffixed to the second in-ear device. In some examples, each of the firstin-ear device and the second in-ear device are removable. In otherexamples, the first in-ear device is retractable via the first wire andthe second in-ear device is retractable via the second wire.

In further examples, each of the first audio module and the second audiomodule are configured to: sense a noise, identify one or more soundswithin the noise, isolate the one or more sounds, and determine if oneor more of the one or more sounds includes a frequency outside of apredetermined threshold. The predetermined threshold equates to afrequency determined to pose a risk of harm to a user's hearingcapabilities. If one or more of the one or more sounds includes thefrequency outside of the predetermined threshold, each of the firstaudio module and the second audio module are configured to automaticallyor manually alter the one or more of the one or more sounds so that thefrequency does not fall outside of the predetermined threshold andoutput the one or more sounds to each of the first in-ear device and thesecond in-ear device, respectively.

In other examples, each of the first audio module and the second audiomodule are configured to: sense a noise, identify one or more soundswithin the noise, isolate the one or more sounds, and determine if oneor more of the one or more sounds includes a frequency outside of apredetermined threshold. The predetermined threshold equates to afrequency determined to pose a risk of harm to a user's hearingcapabilities. If one or more of the one or more sounds includes thefrequency outside of the predetermined threshold, a notification may betransmitted to the user that one or more of the one or more soundsincludes the frequency outside of the predetermined threshold. Inexamples, each of the first lens and the second lens are mixed-realitycapable lenses. In some examples, the notification is an audionotification transmitted to the user via the first in-ear device and thesecond in-ear device, respectively. In other examples, the notificationis a visual notification transmitted to the user via the mixed-realitycapable lenses of the first lens and/or the second lens. In furtherexamples, the notification is a visual notification transmitted to theuser via a smart device display.

In general, the present invention succeeds in conferring the followingbenefits and objectives.

It is an object of the present invention to provide audio manipulationand sound management systems.

It is an object of the present invention to provide audio manipulationand sound management systems for home audio systems.

It is an object of the present invention to provide audio manipulationand sound management systems for public address systems.

It is an object of the present invention to provide audio manipulationand sound management systems for sound reinforcement systems.

It is an object of the present invention to provide audio manipulationand sound management systems for vehicle audio systems.

It is an object of the present invention to provide audio manipulationand sound management systems for ultrasonic transducers, infrasonictransducers, electro-optical transducers, and/or microwave transducers.

It is an object of the present invention to provide audio manipulationand sound management systems for wearable devices (such as smartglasses).

It is an object of the present invention to share harmful, tech-drivenissues within micro and macro-areas with users and third-party entities.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts a schematic view of a one cluster with some interfaceddevices, according to at least some embodiments described herein.

FIG. 2 depicts a schematic view of how interfaced devices create a soundfingerprint, according to at least some embodiments described herein.

FIG. 3 depicts an illustration of a system engaging in inter-cluster,cluster-to-data source, and cluster-to-cluster data sharing, accordingto at least some embodiments described herein.

FIG. 4 depicts a block diagram of a flowchart of a method, according toat least some embodiments described herein.

FIG. 5 depicts a block diagram of a flowchart of a method, according toat least some embodiments described herein.

FIG. 6 depicts a block diagram of a flowchart of a method, according toat least some embodiments described herein.

FIG. 7A depicts an illustrated embodiment of the present inventionlocated in an automobile, according to at least some embodimentsdescribed herein.

FIG. 7B depicts an illustrated embodiment of the present inventionlocated in an indoor theatre, according to at least some embodimentsdescribed herein.

FIG. 7C depicts an illustrated embodiment of the present inventionlocated in an outdoor stadium, according to at least some embodimentsdescribed herein.

FIG. 8 depicts a block diagram of a flowchart of a method, according toat least some embodiments described herein.

FIG. 9 depicts a schematic diagram of a front view of smart glasses withlenses, according to at least some embodiments described herein.

FIG. 10 depicts a schematic diagram of a front view of smart glasseswithout lenses, according to at least some embodiments described herein.

FIG. 11 depicts a schematic diagram of a side view of a user wearingsmart glasses, according to at least some embodiments described herein.

FIG. 12 depicts a schematic diagram of another side view of a userwearing smart glasses, according to at least some embodiments describedherein.

FIG. 13 depicts a front perspective view of smart glasses, according toat least some embodiments described herein.

FIG. 14 depicts a front view of smart glasses, according to at leastsome embodiments described herein.

FIG. 15 depicts a rear view of smart glasses, according to at least someembodiments described herein.

FIG. 16 depicts a left side view of smart glasses, according to at leastsome embodiments described herein.

FIG. 17 depicts a right side view of smart glasses, according to atleast some embodiments described herein.

FIG. 18 depicts a top view of smart glasses, according to at least someembodiments described herein.

FIG. 19 depicts a bottom view of smart glasses, according to at leastsome embodiments described herein.

FIG. 20 depicts a vehicle driver experiencing unbalanced noise exposurefrom an open left window, prompting an alert by the smart sunglasses ofimpending left-ear damage.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The preferred embodiments of the present invention will now be describedwith reference to the drawings. Identical elements in the variousfigures are identified with the same reference numerals.

Reference will now be made in detail to each embodiment of the presentinvention. Such embodiments are provided by way of explanation of thepresent invention, which is not intended to be limited thereto. In fact,those of ordinary skill in the art may appreciate upon reading thepresent specification and viewing the present drawings that variousmodifications and variations can be made thereto.

As a threshold matter, it should be noted that whenever the phrases“microphone” or “microphone-equipped” are used, it is intended to meanany device that is capable of detecting sound, not merely microphones.For example, a high-performance low frequency antenna connected to asoftware-defined radio may be used to input sound observations into thesystem, or a piezo-electric diagraph may be used to measure thevibrations the correspond to a given sound. These examples are providedto give greater clarity as to what the term “microphone” should beinterpreted as, and not construed as a limiting example.

The system of the present invention operates by integrating clusters ofvarious computing devices and wearable computers with sound managementtechniques and methods so that various sound “fingerprints,” and variousother types of data described herein, can be developed and used tovisualize how sensed data is being perceived in micro or macro-areas. Invarious embodiments, the system of the present invention can beintegrated into an individual's home, vehicle audio system, concertvenues, and other locations where sound is played. In addition, thesystem's components allow for the present invention to be scaled toaccommodate sound management and monitoring control within the largestof venues such as stadiums and other sports arenas.

Due to the devices that are integrated into the system having theability to sense the frequency and magnitude of audio signals, a soundfingerprint (summary) can be generated from deterministic methods. Thesefingerprints are then communicated to a data source and can subsequentlybe processed and used to communicate with external applications andthings such as third-party sound databases. However, the purpose of thissystem is not to be confused. In addition to the sound fingerprintingability of the present invention, it is also capable of utilizing aseries of methods to sense and control audio output in various venues.

In an alternative embodiment, the present invention is located in atrain or airport station that has an intercom system that functionspoorly when noisy crowds are present. If a data source within thesefacilities is able to autonomously collect audio data via a series ofintegrated devices, then with the present invention, the same datasource can adjust system outputs accordingly in order to make importantintercom announcements intelligible. In yet another embodiment, a usercan enter in EQ parameters in their integrated computing device toensure that both the audio perceived by them, and the audio perceived bytheir device is in accordance with some predeterminedparameters/settings. While many short-range wireless technologies can beused with the present invention, preferably one or more of the followingtechnologies will be used: ANT+, Bluetooth, Bluetooth Low Energy,versions 4.1, 4.2, and 5.0, cellular, IEEE 802.15.4, IEEE 802.22,802.11ax (i.e. Wi-Fi 6), 802.11a/b/g/n/ac/ax, 802.15.4-2006, ISA 100a,Infrared, ISM (band); NFC, RFID, WPAN, UWS, WI-FI, Wireless HART,Wireless HD/USB, ZigBee, or Z-wave.

In yet another preferred embodiment, various in-ear systems may beintegrated into the present invention, software-defined and/orcognitive-defined based in-ear transceivers can be used to wirelesslycommunicate with a data source and thus, the output of such an in-earmonitor can be autonomously adjusted after sensing audio output. A givenoutput can be adjusted according to what is sensed within specifiedlocation or what is sensed at external clusters. Similarly to asoftware-defined and/or cognitive-defined based in-ear transceivers, anin-ear monitor system for use with the present invention will preferablycomprise hardware such as, earphones, at least one body pack receiver,at least one mixer and at least one transmitter. These functions canalso be adjusted and controlled via the data source of the presentinvention.

According to an embodiment, the functions of the present inventioninclude sensing and isolating frequency bands associated with musicalinstruments/human voices in the following order: midrange, highs, andlows. According to an embodiment, the functions further includeseparating like frequencies (panning). According to an embodiment, thefunctions additionally include balancing the volume, controlling thedynamic range of the frequencies sensed (compression), performingsubtractive and additive equalization, and/or adding audio effects toprovide additional depth and texture.

Loud noises can often lead to stress and hearing loss. Certainfrequencies and volumes can cause stress in pets, and loud music andother forms of loud sounds have put approximately 1.1 billion youngpeople at risk of suffering from hearing loss. Furthermore, militaryveterans are 30% more likely to suffer from severe hearing loss thannon-veterans. In fact, according to the DoD's Hearing Center forExcellence (HCE), hearing loss is the most-widespread injury amongreturning veterans, driving hearing loss payments to exceed $2 billionin 2016. The present invention provides for an interdisciplinary andtechnologically advanced approach to hearing loss prevention.

It is important to note that noise pollution not only produces negativehealth outcomes for humans, but also, can produce negative outcomes forpets. Loud noises and obtrusive, artificial light negatively affect petssuch as cats and dogs, and can eventually lead to abnormal behaviors,like excessive whining, trembling, barking and panting. These behaviorsare a result of the pets trying to cope with the stress tied tophenomena within their environment, and if left unchecked, can causepanic disorders such as, e.g., separation anxiety, which is not healthyfor both pet owners and pets. It is therefore an object of the presentinvention to provide a method wherein at least one sound and/or lightsensing device can be affixed or integrated into a pet wearable (e.g.dog collar).

Hearing loss can be considered an inevitable cost of military exercisesand war. However, real-time alerts using mobile devices creates anopportunity to implement preventative measures, ultimately reducinghazardous exposure time and thus injury. Study considerations include,data sets, hearing loss incidents among veterans (on the rise), currentpreventative measures, gear, and equipment such as jet engines and otherinherently noisy machinery.

In summary, various embodiments of the present invention are in responseto the DoD commitment to reduce the number of military personnel thatsuffer from hearing loss injury by 1) analyzing hazardous sounds inreal-time 2) alerting service members using wearable mobile devices (newpreventative technique).

According to an embodiment, the present invention provides for a mobilecluster-based apparatus that analyzes, reports, and controls outputsbased on a range of inputs over a swath of frequency bands, withdistinct applications including sound output control, hazardousmillimeter-wave, blue light or RF detection and reporting, andultrasonic and infrasonic wave detection and reporting. Since artificialblue light from devices can accelerate blindness, in a blue lightsensing application, a wearable in close proximity to a user's retina(e.g. located on a collar of a smart jacket) can measure prolonged bluelight retina exposure and report the issue back to the user. Accordingto an embodiment, the apparatus is configurable and uses standardcomputing devices, such as wearables, tablets, and mobile phones, tomeasure various frequency bands across multiple points, allowing asingle user to visualize and adjust sound output, and in some cases,detect and report hazardous signals.

Each year, sound companies spend billions of dollars on audiotechnologies and audio research to find new ways to improve audioquality in performance settings. Proposed is an apparatus and methodthat creatively tackles the issue of poor audio quality and soundperception across various spaces by integrating consumer-based mobiledevices, wearable computers and sound management systems. The ubiquitouscomputing devices in this method and apparatus senses soundwaves,associates sensed audio levels with specific clusters (locations),predicts whether or not an audio-related issue is likely to occur withina specific cluster (for instance, predicts if an echo is likely tooccur), and adjusts audio intensity (and related EQs) accordingly toimprove audio output quality.

Key features of the Mobile Cluster-Based Audio Adjusting Method andApparatus include:

-   -   User/listener-based sound management and control    -   Scalable platform that can incorporate future tech—that is, new        functionalities can be added because the method and apparatus is        designed to seamlessly integrate additional components        including, but not limited to, software applications such as a        ‘sound preference’ application that sets user-based sound        perception settings on a mobile device or wearable computer.    -   Integrates with existing audio hardware and software—such as        in-ear systems, mixer boards and other related audio consoles    -   Autonomous audio sensing    -   Can be configured, manufactured and sold across different        industries (e.g. automobile or audio electronic industries)    -   Can be used in sound fingerprint and music        publishing/performance applications (e.g. in a performance        venue, fingerprint data can be sent directly to music publishing        entities from the described clusters    -   Can interface with various communication offerings such as        e-mail, SMS, and visual screens (for instance, communicative        updates can be sent with sensed audio measurements. A specific        example—an SMS that reads a “too loud in section A′/cluster A)    -   Can support a fixed or unfixed number of “sensing units”

Referring to FIG. 1, an embodiment of one cluster 101 of the presentinvention with some interfaced devices. Specifically, three embodimentsof at least one computing device 102 are shown; wearable glasses,wearable watch, and a smartphone. It should be noted that while thesethree devices are listed as exemplary examples, any device with a soundsensing mechanism 150 and a way to transmit any recorded data issuitable for use as one of said at least one computing devices 102.According to an embodiment, the sound sensing apparatus may be anomnidirectional transducer, an ultrasonic transducer, an infrasonictransducer, a microwave transducer, and/or any other suitable soundsensing apparatus, while maintaining spirit of the present invention.The sound sensing mechanisms of at least one computing device 102 willbe able convert perceived sounds into electronic signals so that therecorded information may be transmitted to neighboring clusters 101, ora data source (See FIG. 3), as desired. This data will be transmittedusing either one or a combination of short-range wireless technologies,namely, ANT+, Bluetooth, cellular, IEEE 802.15.4, IEEE 802.22, ISA 100a,Infrared, ISM (band), NFC, RFID, WPAN, UWS, WI-FI, Wireless HART,Wireless HD/USB, ZigBee, or Z-wave. Preferably, transducers integratedinto these computing devices have an output signal that is fed into theinput of an analog-to-digital converter (“ADC”) and can incorporatesoftware and cognitive-defined radios to broaden the selection ofcompatible wireless communication interfaces and limit radio componentfootprints. According to an embodiment, the at least one computingdevice 102 includes one or more wireless transceivers 155.

FIG. 2 shows a schematic view of how interfaced devices create a soundfingerprint. The sound transmission of the audio energy 109 sensed bythe at least one computing device 102 propagates through air and isreceived by at least one computing device 102 using the transmissionpath outlined in FIG. 2.

Assuming that FIG. 2 depicts audio transmission in an indoor setting, atspecified time intervals, each computing device measures the soundpressure level (SPL) and sound power level (SWL):

${SPL} = {{SWL} + {10{\log \left\lbrack {\frac{Q_{\theta}}{4\pi r^{2}} + \frac{4}{R_{C}}} \right\rbrack}}}$

Where:

SPL=Sound pressure level dB

SWL=Sound power level=10 log₁₀(W/W_(ref))

-   -   W is the total sound power radiated from a source with respect        to a reference power (W_(ref)) dBW re 10⁻¹² Watts.    -   r=distance from source m    -   Q_(θ)=directivity factor of the source in the direction of r    -   S=total surface area of a room m²    -   α_(av)=average absorption coefficient in a room

$R_{C} = {{{room}\mspace{14mu} {constant}} = {\frac{{S\alpha}_{av}}{1 - \alpha_{av}}m^{2}}}$

Over time, each computing device in FIG. 2 detects differences inpressure (i.e. change in pressure vs. time) and converts the differencesinto an electrical signal. A Fast Fourier Transform is implemented(locally or in a cloud) to measure the relative amplitudes of thefrequencies ‘sensed’ and to perform other frequency domain analyses.

It is important to note that in any given indoor environment, R_(c),α_(av), and S can be predetermined and made available to each computingdevice, approximated or deemed negligible. Also note that each computingdevice in FIG. 2 has a microphone. Computing devices may also obtainsound observations via a high-performance low frequency antenna.

Turning to FIG. 3 an illustration of an embodiment of the system of thepresent invention engaging in intra-cluster, cluster-to-data source; andcluster-to-cluster data sharing. Here, each cluster has a given location110 (i.e. specified location) to accurately isolate and associate thesensed data. In one embodiment, the present invention is able to adjusta given output device 160 based on its proximity to a given location 110of a cluster. In alternative embodiments, output devices 160 can beadjusted based on their proximity to more than one cluster. Devices ineach cluster can either communicate directly to each other or a datasource 111, devices within a cluster can communicate to a single devicewithin that cluster which can serve as a gateway to other clustersand/or data source 111. In some embodiments, the present inventionfurther comprising an in-ear monitoring device 112. According to anembodiment, the output devices 160 may include a power source 165 (suchas, e.g., a battery or other suitable power source 160), a speaker 170,a communication mechanism 175 (such as, e.g., a wired and/or wirelesstransceiver), and/or any other suitable mechanisms (as shown in FIG. 1).According to an embodiment, the data source 111 includes a memory 180, aprocessor 182, an interface mechanism 184, and/or at least one inputmechanism 186. According to an embodiment, the interface mechanism 184is a graphical user interface with a display (e.g., a touch screendisplay). According to an embodiment, the at least one output device 160is located within said at least one cluster 101, such that said datasource 111 may alter the power supplied to said speaker 170 inreal-time.

The embodiment depicted here shows devices that sense audio signalenergy within the confines of a single cluster and then sends datadirectly to an audio control unit and other clusters. Therefore, notonly can these computing devices wirelessly share sensed data with eachother, but, also, data can be shared with an data source 111 (for audiooutput management purposes) and other devices in other clusters.Depending on the audio signal energy sensed within a specificcluster(s), data source 111 adjusts any connected output devices ineither a single cluster, or multiple clusters to ensure highquality/fidelity output.

FIG. 4 shows a flow chart outlining an embodiment of the method of thepresent invention. Here, method 200 is comprised of a number of steps.In step 201, initially, both desired and undesired audio output signalsare sensed and subsequently analyzed. In step 202, the method proceedsto determine whether or not the input signals match a set of predefinedthresholds. If there is only negligible output audio, that is, if theaudio within an environment is outside of a specified frequency range,the method proceeds to step 203 where the devices in each clusteroperate in sleep mode. If there is indeed sensible audio output, themethod proceeds to step 204 where the present invention determines ifthe predefined threshold or EQ setting is breached. If this threshold isbreached, the method moves to step 205 where the first device thatsensed the breach will (preferably, wirelessly) communicate its signalmeasurements to other devices within its cluster and the receivingdevice will conduct the same audio measurements to confirm the thresholdbreach. Preferably, step 205 is repeated amongst all of the deviceswithin a single cluster, to provide more robust data sets. Once thebreach confirmation stage is completed, in step 206, the presentinvention moved to step 207 where at least one computing device ischosen to communicate the breach to. Finally, in step 208, when thepresent invention, via the audio control source, adjusts audio levels atthe at least one output device to transform undesired audio outputs todesired audio outputs.

Referring now to FIGS. 5-6, a flowchart 300 of an embodiment of thepresent invention is illustratively depicted, in accordance with anembodiment of the present invention.

According to an embodiment, the present invention isolates and/orseparates sounds within band, reports findings of those sounds to acloud-based system for audio signal processing (if necessary), and sendscontrol commands to one or more commercial mixing consoles and/or audiocontrol sources to alter the audio output (if necessary), and thencommunicate with apparatus devices to share and confirm sensed audiofindings (if necessary). According to an embodiment, these sounds areassociated with different frequencies and/or are associated with one ormore instruments.

At step 305, audio/noise is sensed by one or more audio sensing devices.According to an embodiment, the one or more sensing devices aremicrophones.

At steps 310-315, the volume between the sensed audio is balanced. Thatis, one or more instruments and/or frequencies are identified andisolated from the sensed audio (at step 310), and the signal amplitudeof each instrument is manipulated using a mixing console/audio source(at step 315). It is noted, however, that, at step 310, the identifiedsounds need not always be instruments. The sounds may be any suitableidentifiable sounds, while maintaining the spirit of the presentinvention.

According to an embodiment, the present system may sense different typesof phenomena (e.g., it may sense audio using an audio transducer such asa microphone, it may include a smartwatch and/or other similar devicethat may be able to sense ultrasonic waves using an ultrasonictransducer, and/or the system may incorporate one or more varioussuitable types of transducers). According to an embodiment, the systemmay be configured to sense environmental phenomena outside of theacoustic frequency range by using a variety of transducers. In thosecases, the underlying functionality of the system generally remains thesame, regardless of the input phenomena sensed. The system may measurethe intensity of an acoustic wave, ultrasonic wave, infrasonic wave,and/or any other suitable waves.

According to an embodiment, the system may incorporate variousinput/output functions/details, such as those shown in Table 1.According to an embodiment, the system is configured to sense, analyze,and/or control audio outputs.

TABLE 1 SYSTEM INPUT SYSTEM FUNCTION OUTPUT Network Interface: Apparatuswill isolate/separate sounds Network Interface Configured Sense audiblewithin band, report findings to cloud- to: sounds via mic or basedsystem for audio signal Control mixing console(s) comparable audioprocessing (if necessary), send control and/or an audio control sensingtransducer commands to commercial mixing source(s) via physical or SDR-console and/or data sourceto alter audio based transceiver(s)** output(if necessary) and communicate with apparatus devices to share andconfirm sensed audio findings (if necessary) 20-40 Hz Sub Bass *(Piano,Synthesizer Strings) kHz: 125/134 40-160 Hz Bass Band (Drums, Strings,Winds, MHz: 13.56/600/ Vocals, Piano, Synthesizer)800/850/900/1700/1800/1900 160-300 Hz Upper Bass Band (Drums, Strings,2100/2200/L700/U700/2300/ Winds, Vocals, Piano, Synthesizer)2400/2500/2700/3500/5200/ 300-800 Hz Low-Mid Band (Drums, Strings,Winds, 5700/whitespaces between 54 Vocals, Piano, Synthesizer) and 860/800-2.5 kHz Mid-Range Band (Drums, Strings, GHz: 3.6/4.9/5/5.9 /24 to300 Winds, Vocals, Piano, Synthesizer) 300 GHz to 430 THz 2.5-5 kHzUpper Mid Band (Drums, Strings, Winds, Vocals, Piano, Synthesizer) 5-10kHz High Frequency Band (Drums - including Cymbals, Synthesizer)Ultra-High Freq Bands (Hi-Hat, Cymbals, Hiss)

It is also noted that the present invention may further haveimplications in sensing and analyzing millimeter waves, which the humanear cannot hear. Higher-frequency millimeter-waves can possibly haveadverse effects on human health. According to an embodiment, the presentsystem can (as shown in Table 2), in real-time, detect and reportharmful, high-energy level millimeter waves, which are included in many5G deployment plans.

TABLE 2 SYSTEM INPUT SYSTEM FUNCTION OUTPUT Network Interface: SenseApparatus will detect, Network Interface Configured to: millimeter-wavesvia a analyze, measure and/or Report/share data via physical or mm Wavetransducer report harmful millimeter- SDR-based transceiver(s)** wavesacross several environments 24 to 300 GHz Identify and measure kHz:125/134 millimeter-wave MHz: 13.56/600/800/850/900/ characteristics1700/1800/1900 2100/2200/L700/U700/2300/ 2400/2500/2700/3500/5200/5700/whitespaces between 54 and 860/ GHz: 3.6/4.9/5/5.9 /24 to 300 300 GHz to430 THz

Weaponized infrasonic and ultrasonic devices with highly directionalenergy transmissions can produce both psychological and physical effectson humans. In addition, blue light (short wavelength) emitted fromdisplays is harmful to the retina. For this reason, a light sensingtransducer is a part of the apparatus described herein. According to anembodiment, the present system can, in real-time, detect and reportharmful infrasonic and ultrasonic devices in weaponized scenarios.According to an embodiment, the apparatus described can (as shown inTable 3), in real-time, detect and report harmful infrasonic andultrasonic devices in weaponized scenarios.

TABLE 3 SYSTEM INPUT SYSTEM FUNCTION OUTPUT Network Interface: SenseApparatus will detect, Network Interface infrasonic, ultrasonic analyze,measure and/or Configured to: waves, and/or light waves report onharmful ultrasonic Report/share data via via an ultrasonic, infrasonicor infrasonic waves across physical or SDR-based or electro-opticalseveral environments transceiver(s) transducer 18.9 Hz, 0.3 Hz, 7 Hz andIdentify and measure kHz: 125/134 9 Hz ultrasonic, infrasonic or MHz:13.56/600/ 700 kHz to 3.6 MHz visible wave characteristics800/850/900/1700/1800/1900 20 to 200 kHz 2100/2200/L700/U700/ 400-770THz 2300/2400/2500/2700/3500/ 5200/5700/whitespaces between 54 and 860/GHz: 3.6/4.9/5/5.9 /24 to 300 300 GHz to 430 THz

At step 320, it is determined whether the sensed audio includes anyaudio in frequencies that have been predetermined to be hazardous tohuman ears. According to an embodiment, if audio in the hazardous rangehas been detected, then one or more users are notified, at step 325. Thenotification may take the form of a visual notification, an audiblenotification, and/or any other suitable form of notification. It isnoted, however, that, if automatically corrected, the user need notalways be notified.

According to an embodiment, at step 330, the dynamic range of the sensedaudio (compressed or limiting) is controlled by sending audio data to amixing console/data source or cloud-based system that can identify andmitigate sudden peaks in a sensed audio stream to help sound(s) sitconsistently in an audio mix (accomplished by removing sudden peaks).Altering the dynamic range may also be used to eliminate any audio inthe predetermined hazardous range. At step 335, the audio is panned.That is, like frequencies in the sensed audio are separated.

At step 340, effects that add depth and texture to audio outputs areadded and, at step 345, equalization is added using subtractive and/oradditive equalization techniques.

According to an embodiment, at step 350, automation is generated thatpredicts environmental conditions based on sensed data (like echoes andaudio wind steers) and, at step 355, volume changes and audio effectsare autonomously programmed, accordingly.

According to an embodiment, the present invention includes acoustic bandapplications. Consumer products, such as, e.g., wearables, smartphones,and other portable computing devices autonomously control soundoutput(s) in private spaces (e.g. cars and homes) and public spaces(e.g. transport stations and theater/concert venues). According to anembodiment, the present system senses audible sounds via a mic orcomparable audio sensing transducer and isolates/separates sounds withincertain bands, reports findings to cloud-based system(s) for audiosignal processing, sends control commands to a commercial mixing consoleand/or data source to alter audio output, and communicates with clusterdevices to share and confirm sensed audio findings. According to anembodiment, the present system outputs to control mixing console(s)and/or an audio control source(s) via physical or SDR-basedtransceiver(s).

According to an embodiment, the present system senses and analyzes audiofrequencies across clusters to adjust and control audio output andperceived sound at a given locale. In order to achieve high-qualitysound and sound equalization of a sonic presentation, a sound system'saudio output levels are autonomously adjusted via a central audio mixingsource using intelligent tell-tale frequency characteristics gatheredfrom clusters comprised of smart devices and/or wearable computers.

According to an embodiment, the audio signal data obtained withinclusters enables a system integrated mixing console to manage audiooutput based on detailed frequency descriptions of acoustic propertiesand characteristics across a venue, room, or vehicle. According to anembodiment, the present system incorporates a modular structure so thatcomponents can be added and expand as consumer needs grow.

According to an embodiment, the present system provides for an apparatusthat is configured to adjust and control audio output signal levelsacross multiple cluster locales using computing devices such assmartphones and/or wearable computers; a wireless transmission platform;transceivers—software-defined, cognitive-defined and/orhardware-defined; wireless microphones; in-earmonitors—software-defined, cognitive-defined and/or hardware-defined;and a central audio mixing source.

According to an embodiment, the apparatus of the present invention mayinclude, but is not limited to, the following functions:

-   -   Balancing the volume between sensed audio. For example,        isolating instruments based on frequency and manipulating the        signal amplitude of each instrument using a mixing console/audio        source.    -   Controlling the dynamic range of the sensed audio (compress or        limiting) by sending audio data to a mixing console/audio source        or cloud-based system that can identify and mitigate sudden        peaks in a sensed audio stream to help sounds sit consistently        in an audio mix (accomplished by removing sudden peaks).    -   Panning.    -   Adding effects that add depth and texture to audio outputs.    -   Equalization using subtractive/additive equalization techniques.    -   Automation that 1) predicts environmental conditions based on        sensed data (like echoes and audio wind steers) and 2)        autonomously programs volume changes and audio effects        accordingly.

Referring to FIGS. 7A-7C, various embodiments of the present inventionimplemented in an automobile, an indoor theatre, and an outdoor stadium,respectively, are shown. While these venues are particularly suited forthe present invention to be implemented in any venue in which there aremultiple listeners.

In a preferred embodiment, the sound sensing mechanisms (preferably,transducers) used within each “sensing” computer/device outputs anoutput signal that is fed into the input of an ADC. In theconfigurations described in FIGS. 7A, 7B and 7C, a single-ended ADCinterface can be used effectively since ADCs and the transducer sourceare both located on the same integrated circuit board. However, sincefully differential interfaces have performance gains over single-endedinputs due to its inherent noise rejection characteristics, using afully-directional interface instead of a single-ended interface may bedesirable.

FIG. 8 shows a flow chart outlining an embodiment of the method of thepresent invention. Here, method 400 is comprised of a number of steps.According to an embodiment, the method as shown and described in FIG. 8showcases the method steps of a system that measures the intensity ofphenomena and its purpose is to sense, analyze, report, and, in somecases, control invisible phenomena. These invisible phenomena caninclude, e.g., ultrasonic waves, audio waves, infrasonic waves, mm wavesetc. (using ultrasonic transducers, infrasonic transducers, microwavetransducers, among others, and associated software for theseapplications).

As in method 200 of FIG. 4, initially, both desired and undesiredsignals are sensed and subsequently analyzed. It is then determinedwhether or not the input signals match a set of predefined thresholds.If there is only negligible sensed data, that is, if the signal withinan environment is outside of a specified frequency range, the devices ineach cluster operate in sleep mode, step 402. If there is indeed asensible signal, the method proceeds to step 401 where the presentinvention determines if the predefined threshold or EQ setting isbreached. If this threshold is not breached, the device operates insleep mode 402. If this threshold is breached, the method moves on tostep 403, where it is determined whether the device has a navigationunit. According to an embodiment, devices in the system can auto-awakenout of sleep mode based on the location of the device (e.g. when a userwalks into a concert venue, the system will begin measuring surroundingsignal energy).

If the device does not have a navigation unit, the method moves to step404, where a breach severity measurement is determined. Once the breachseverity measurement is determined, the method moves to step 405, whereit is determined whether there is an onset issue.

If there is an onset issue, the method moves to step 406, in which anydata and/or findings are reported and/or displayed. Once the data and/orfindings are reported and/or displayed, the device returns to sleepmode, step 402.

If there is not an onset issue, the method moves to step 407, wherein atime window is calculated at which any sensed data was determined to beunacceptable. Once this time window is calculated, the method moves tostep 408, wherein breaches within the calculated time window arecollected and/or analyzed. Once the breaches within the calculated timewindow are collected and/or analyzed, the method moves to step 409,wherein it is determined whether there were consistent breaches duringthe time window. If there were consistent breaches during the timewindow, the method moves to step 406. If there were not consistentbreaches during the time window, the device goes back to sleep mode,step 402.

If the device has a navigation unit, the method moves to step 410,wherein breach severity measurements with the device's location aredetermined. Once the breach severity measurements with the device'slocation are determined, the method moves to step 411, wherein it isdetermined whether the device's location at the time of the breachlessened the severity of the breach. If the device's location at thetime of the breach did not lessen the severity, the method moves to step405, wherein it is determined whether there is an onset issue. If thedevice's location at the time of the breach did lessen the severity, themethod moves to step 412, wherein an analysis takes place in whichlocation and machine learning insights are factored into the thresholdbreach calculations. The method then moves to step 413, where it isdetermined if the breach is still an issue. If the breach is still anissue, the method moves to step 405, wherein it is determined whetherthere is an onset issue. If the breach is not still an issue, the devicegoes back to sleep mode, step 402.

According to an embodiment, environmental measurements may be skeweddepending on the device's location (e.g., in a bag, in a pocket, etc.).According to an embodiment, the location of the device is detected, and,in these cases, the system will either account for signal degradation inthe measurement or disable environmental measurements based onpredefined thresholds. According to an embodiment, smart devices (e.g.,smartphones, etc.) will use an accelerometer and/or light sensor and/ora temperature sensor to detect whether or not the smart device isdirectly exposed to phenomena (i.e. whether or not the device is in abag or pocket).

The methods and systems described herein may also be used with wearabledevices, such as smart glasses. As explained supra, devices may beharmful to the human body. Artificial blue light emitted from devicescan accelerate blindness. Devices may additionally result in hearingloss. Furthermore, 5G devices may alter cell growth. To combat theseissues, wearable devices may be configured to warn users of harmful,technology-driven environmental conditions. A pair of smart glasses 500may be depicted, at least, in FIG. 9-FIG. 19.

As depicted, the pair of smart glasses 500 may include a first lens504A, a second lens 504B, and a frame. The first lens 504A and thesecond lens 504B may be depicted, at least, in FIG. 9, FIG. 13, FIG. 14,FIG. 15, FIG. 16, FIG. 17, FIG. 18, and FIG. 19. The frame of the pairof smart glasses 500 may be depicted, at least, in FIG. 13, FIG. 18, andFIG. 19. Each of the first lens 504A and the second lens 504B may be areplaceable prescription lens, a replaceable protective lens, areplaceable mixed-reality capable lens, a permanent prescription lens, apermanent protective lens, or a permanent mixed-reality capable lens,among other examples not explicitly listed herein.

The frame may include a first lens frame component 520A configured toreceive the first lens 504A and a second lens frame component 520Bconfigured to receive the second lens 504B (as depicted in FIG. 13). Theframe may also include a bridge 506 disposed between and configured toaffix the first lens frame component 520A to the second lens framecomponent 520B (as depicted in FIG. 13). The frame may additionallyinclude a first nose pad 530A and a second nose pad 530B (as depicted inFIG. 18).

The frame may further include a first temple 502A (as depicted in FIG.13, FIG. 16, FIG. 18, and FIG. 19) affixed at a first location 528A (asdepicted in FIG. 13) to the first lens frame component 520A (as depictedin FIG. 13) and a second temple 502B (as depicted in FIG. 13, FIG. 17,FIG. 18, and FIG. 19) affixed at a second location 528B (as depicted inFIG. 13) to the second lens frame component 520B (as depicted in FIG.13). Moreover, a first audio module (not shown) may be located on aninterior of the first temple 502A above a first ear of the user 526 whenthe user 526 is wearing the pair of smart glasses 500. A second audiomodule 532 may be located on an interior of the second temple 502B abovea second ear of the user 526 when the user 526 is wearing the pair ofsmart glasses 500 (as depicted in FIG. 13). In some examples, the framecomprises one or more materials having reflective wave characteristicsto shield a head of a user 526 from unsafe frequencies.

The pair of smart glasses 500 may also include a light sensing module512 (as depicted in FIG. 9, FIG. 10, FIG. 13, and FIG. 14) and acharging port 522 (as depicted in FIG. 15), each being located at thebridge 506 (as depicted in FIG. 13, FIG. 14, and FIG. 18). The lightsensing module 512 may be located on a front side of the pair of smartglasses 500 and the charging port 522 may be located on a rear side ofthe pair of smart glasses 500. A charging cord or device may beconnected to the charging port 522 to charge the pair of smart glasses500. The front side may be disposed opposite the rear side of the pairof smart glasses 500. The rear side of the pair of smart glasses 500 maybe configured to be located closer to the face of the user 526 than thefront side.

As explained, the blue light emitted from displays is harmful to theretina and can accelerate blindness in the user 526. For this reason,the light sensing module 512 may be a light sensing transducer. In otherexamples, the light sensing module 512 is configured to scan anenvironment to detect environmental hazards and transmit a notificationto a first in-ear device 518A (as depicted in FIG. 9, FIG. 10, FIG. 12,FIG. 14, FIG. 15, FIG. 16, FIG. 18, and FIG. 19) and a second in-eardevice 518B (as depicted in FIG. 9, FIG. 10, FIG. 11, FIG. 14, FIG. 15,FIG. 17, FIG. 18, and FIG. 19) to inform the user 526 of the detectedenvironmental hazards.

The pair of smart glasses 500 may further include an augmented realitydisplay interface port 514 (as depicted in FIG. 13, FIG. 14, FIG. 16,and FIG. 18) located at the first lens frame component 520A. Theaugmented reality display interface port 514 may be located on the frontside of the pair of smart glasses 500. The augmented reality displayinterface port 514 may be used for add-on devices or components.

Moreover, the pair of smart glasses 500 may further include a first wire516A (as depicted in FIG. 9, FIG. 10, FIG. 12, FIG. 14, FIG. 15, FIG.16, FIG. 18, and FIG. 19) and a second wire 516B (as depicted in FIG. 9,FIG. 10, FIG. 11, FIG. 14, FIG. 15, FIG. 17, FIG. 18, and FIG. 19).Materials comprising the first wire 516A and the second wire 516B arenon-limiting. The first wire 516A and the second wire 516B may each havea first side disposed opposite a second side. The first side of thefirst wire 516A may be affixed to the first location 528A. The secondside of the first wire 516A may be affixed to the first in-ear device518A. The first side of the second wire 516B may be affixed to thesecond location 528B. The second side of the second wire 516B may beaffixed to the second in-ear device 518B.

In examples, each of the first in-ear device 518A and the second in-eardevice 518B are removable. In further examples, the first in-ear device518A is retractable via the first wire 516A and may be stored in asleeve (not shown) located on an interior of the first temple 502Aproximate a head of the user 526 when the pair of smart glasses 500 areworn. The second in-ear device 518B is retractable via the second wire516B and may be stored in a sleeve 510 located on an interior of thesecond temple 502B proximate the user's head when the pair of smartglasses 500 are worn (as depicted in FIG. 13).

In additional examples, each of the first audio module (not shown) andthe second audio module 532 may be configured to sense a noise, identifyone or more sounds within the noise, isolate the one or more sounds, anddetermine if one or more of the one or more sounds includes a frequencyoutside of a predetermined threshold. The predetermined thresholdequates to a frequency determined to pose a risk of harm to a hearingcapability of the user 526. If one or more of the one or more soundsincludes the frequency outside of the predetermined threshold, each ofthe first audio module (not shown) and the second audio module 532 areconfigured to automatically alter the one or more of the one or moresounds so that the frequency does not fall outside of the predeterminedthreshold and output the one or more sounds to each of the first in-eardevice 518A and the second in-ear device 518B, respectively, for theuser 526. In other examples, if the one or more of the one or moresounds includes the frequency outside of the predetermined threshold,each of the first audio module (not shown) and the second audio module532 are configured to transmit a notification to the user 526 via thefirst in-ear device 518A and the second in-ear device 518B,respectively, that one or more of the one or more sounds includes thefrequency outside of the predetermined threshold.

An exemplary usage scenario is illustrated in FIG. 20, in which avehicle driver wearing smart glasses is experiencing unbalanced noiseexposure from an open left window. That is, the driver's right ear'spotential exposure to noise in the vehicle cabin is generally farquieter than their left ear's potential exposure to noise from the openwindow, Thus, a loud noise from the outside, such as noise fromconstruction equipment, wind, an accident, a siren, or the like mayimpact the driver's left ear far more than their right ear. In thisscenario, a sonic transducer operatively coupled to the smart glassesand having an input near the left ear, may be able to detect adangerously high noise level impinging on the left ear, while anothertransducer with an input similarly disposed near the right ear may not.In response, a processor within or operatively coupled to the transducermay generate an alert of possible or probable risk of left-ear damage(e.g. via the smart glasses and/or car display unit and/or seat byvibration, beep, or display notification). This may give the wearer ofthe smart glasses an opportunity to take action to mitigate the harmfulnoise, such as by closing the open window, or covering their left earwith their hand, for example.

In embodiments, the smart glasses may additionally or alternatively beconfigured to include, or may be operatively coupled to, a module forlight sensing and promoting eye health, with a light transducer havingan input at or near the position of the wearer's eyes. This may guardagainst eye strain from light impinging on the wearer's eyes, eitherwithin or beyond the visible range, by continuously monitoring andmeasuring light of one or more default or select frequencies orfrequency ranges. For example, the intensity of blue light impinging onthe wearer's eyes from viewing a digital screen or other light emittingdevice may have an undesired effect on the wearer's eyes, or caused bythe wearer's eyes (e.g., upon the brain), such as sleep-related issues.The smart glasses may include or be operatively coupled to a processorthat may, responsive to detecting a possibly harmful amount of lightimpinging on the wearer's eyes, notify the wearer (e.g. via vibration,beep, or display notification). This may induce them to shift their eyesaway from, filter with dark or polarized lenses, or otherwise mitigate,the harmful light. In an embodiment, the notification may includeinformation of, or a recommendation regarding, the harmful light, suchas specifying a time period to avoid, or to limit exposure to, theharmful light. In an embodiment, the processor may be operativelycoupled to an artificial source of the harmful light, such as a lightemitting diode (LED) display for example, and may autonomously alter thedisplay outputs. Studies indicate the best way to protect eyes from harmdue to viewing blue light generated by a source of blue light (e.g. adevice display) is to reduce the time spent viewing the blue lightsource, and not to simply filter out the blue light. A warning mayprovide this information to the wearer.

In another currently preferred embodiment, the smart glasses may beconfigured to include, or may be operatively coupled to, a module forsound sensing and promoting hearing health, with a sound transducerhaving an input at or near the position of the wearer's ears. This mayguard against loss of hearing from sounds impinging on the wearer's earswithin or beyond the hearing frequency range, by continuously monitoringand measuring sounds of one or more select frequencies or frequencyranges. The glasses may include or be operatively coupled to a processorthat may, responsive to detecting a possibly harmful amount of soundimpinging on the wearer's ears, notify a user (e.g. via vibration, beep,or display notification). This may induce them to wear ear protection,or otherwise mitigate, the harmful sound. In an embodiment, thenotification may include information of, or a recommendation regarding,the harmful sound. In an embodiment, the processor may be operativelycoupled to a controllable source of the harmful sound, such as a speakerin an automobile coupled to a head unit, and may autonomously alter thespeaker outputs.

Further, the sound module may be designed to provide one or more of thefollowing capabilities, including by implementing frequency isolationand filtering.

It is known that extensive use of in-ear devices can disrupt or distorta human's ordinary auditory perception. In embodiments, if the soundmodule senses an audio stream that may be causing harm, it may beconfigured to cause attached ear bud speakers or the like of the moduleto go into an auto-off mode, and the audio stream may be continued viasound module speakers (on smartglasses frame) or on surrounding externalaudio outputs. See, e.g., FIGS. 11, 12, the speakers of which may bothbe included in a single embodiment.

A sound module with an audio input (e.g. mic, vibration sensor) placedabove each ear may approximate how a user hears; the inputs may worktogether to calculate the approximate spatial direction of a noisesource. This functionality may be used to address the issue ofasymmetric hearing loss. For instance, truck drivers may suffer fromasymmetric hearing loss due to unbalanced noise exposure from an openwindows driver side window while driving. In the event a truck driver inthe U.S. consistently has their left window open, the module may inreal-time detect the direction of the noise origin (map it to the leftor right ear), and notify the truck driver of impending left-ear damage.See FIG. 20.

The herein disclosed smart glasses may be configured and programmed todetect certain discrete sound patterns, and autonomously respond to adetected pattern. For example, loud noise sources with rapid changes insound (like jack hammers) and sources with prolonged tones (likesirens), are distinct with regard to hearing loss (more specifically,conductive hearing loss). At similar signal intensities, one soundpattern may do more harm to a person's hearing than another. The hereindisclosed smart glasses may be configured to differentiate betweenvarious sound patterns and autonomously act to mitigate potentiallyharmful sounds and/or warn users accordingly.

Studies also show that high-pitched sounds and sounds at certainfrequencies may damage the auditory nerve and contribute tosensorineural hearing loss, which is irreparable. In order to preventsensorineural hearing loss, the herein disclosed smart glasses softwaremay isolate and monitor audio streams at predetermined or selectedpotentially harmful frequencies, and/or above a predetermined or selectthreshold frequency. When these are detected, the smart glasses mayautonomously act to warn users, and/or modify or remove noise of aspecific frequency or higher than a threshold frequency from audiooutput(s).

Music or sounds at certain frequencies can cause tinnitus symptoms, orcause tinnitus symptoms to worsen. In embodiments, smart glasses mayincorporate tinnitus-related frequency information from the user. Thesmart glasses may filter sounds of such frequencies to remove, orotherwise mitigate, said frequencies from in-ear or surrounding audiooutputs.

In embodiments, a connector may be included in the smart glasses (e.g.,a USB-C or other connector). The connector may be used to couple thesmart glasses to another device, and to communicate with the device, toreceive inputs from and/or to output control signals to the coupleddevice. For example, an augmented reality (AR) or other heads-up displaymay be coupled to the smart glasses. Plug and Play connectivity may beused in conjunction with coupling the smart glasses to the other device.

Other embodiments may be configured to modify sound, light, and/or otherelectro-magnetic inputs to promote the user's health with regard to thefollowing issues.

Absorbed radiation from some electronic devices may increase tumoroccurrence and/or excessively heat various tissues within the body. Theherein disclosed smart glasses may be configured to interface with andcontrol devices emitting the radiation to reduce the incidence of suchtumors.

Infrasonic waves produced by machines like windmills may cause headachesand nervousness; and ultrasonic sources with high-intensity and focusedbeams may cause headaches and dizziness. Properly configured smartglasses as disclosed herein may counter these effects by interfacingwith and controlling the sources of infrasonic and ultrasonic sound.Alternatively, the glasses may interface with and control complementarysound sources to emit sound that cancels at least some of the harmfulinfrasonic and ultrasonic sound.

Thus, the flexible architecture of the disclosed smart glasses may allowthe smart glasses to be configured, arranged, and/or programmed toprovide these and other benefits for mitigating harmful effects of EMF,infrasonic and ultrasonic sources in various scenarios.

When introducing elements of the present disclosure or the embodiment(s)thereof, the articles “a,” “an,” and “the” are intended to mean thatthere are one or more of the elements. Similarly, the adjective“another,” when used to introduce an element, is intended to mean one ormore elements. The terms “including” and “having” are intended to beinclusive such that there may be additional elements other than thelisted elements.

While the disclosure refers to exemplary embodiments, it will beunderstood by those skilled in the art that various changes may be made,and equivalents may be substituted for elements thereof withoutdeparting from the scope of the disclosure. In addition, manymodifications will be appreciated by those skilled in the art to adapt aparticular instrument, situation or material to the teachings of thedisclosure without departing from the spirit thereof. Therefore, it isintended that the disclosure not be limited to the particularembodiments disclosed.

What is claimed is:
 1. Smart glasses, comprising: a frame; at least onesignal input device coupled to the frame; at least one signal outputdevice coupled to the frame; a computing processor operatively coupledto the signal input device and the signal output device; a memorycontaining computer-executable instructions operatively coupled to theprocessor to process an input signal received by the signal input deviceand generate an output signal and send it to the signal output device,wherein the input signal is processed to determine if there is a risk ofharm from the input signal to a wearer of the smart glasses, and in thecase it is determined there is a risk of harm the generated outputsignal is customized to mitigate the risk caused by the input signal;and at least one power source coupled to the signal input device, thesignal output device, the processor, and the memory.
 2. The smartglasses of claim 1, wherein the input signal is one of a sound wave andan electro-magnetic (em) wave.
 3. The smart glasses of claim 1, whereinthe input device includes at least one microphone, and the output deviceincludes at least one speaker.
 4. The smart glasses of claim 3, whereinat least one first speaker coupled to the glasses is disabled and atleast one second speaker disposed at a different position than the firstspeaker is enabled.
 5. The smart glasses of claim 4, wherein the secondspeaker is physically coupled to the glasses.
 6. The smart glasses ofclaim 4, wherein the second speaker is not physically coupled to theglasses.
 7. The smart glasses of claim 3, wherein the at least onespeaker includes a first speaker proximate the left ear of the wearerand a second speaker proximate the right ear of the wearer.
 8. The smartglasses of claim 7, wherein the output signal sent to the first speakerand the output signal sent to the second speaker are individuallycustomized to mitigate the risk of harm to the wearer's left ear orright ear, respectively, or both.
 9. The smart glasses of claim 1,further comprising a filter for filtering the output signal before it issent to the output device.
 10. The smart glasses of claim 9, wherein thefilter comprises one of a notch filter, a band-pass filter, and alow-pass filter.
 11. The smart glasses of claim 10, wherein the filteris realized by the processor, including calculating a Fast FourierTransform (FFT) of the input signal to convert it to a frequency domainand measuring amplitudes of frequencies found in the input signal. 12.The smart glasses of claim 1, further comprising a transmitter to sendcontrol signals generated by the processor to an external signal outputdevice.
 13. The smart glasses of claim 1, wherein the input deviceincludes at least one electro-magnetic (em) radiation sensor disposedproximate the wearer's eyes, and the output device includes at least oneem radiation modifying element.
 14. The smart glasses of claim 13,wherein the em radiation is in the visible frequency range and theoutput device includes at least one filter.
 15. The smart glasses ofclaim 13, wherein the em radiation is in a cellular communicationfrequency range and the output device includes at least one antenna. 16.The smart glasses of claim 15, wherein the em radiation emitted by theat least one antenna is configured to mitigate the cellular signalimpinging on the wearer's brain.
 17. The smart glasses of claim 1,wherein the smart glasses are configured to send a notification to thewearer responsive to the processing of the input signal determiningthere is a risk of harm from the input signal to the wearer of the smartglasses.
 18. The smart glasses of claim 17, wherein the notificationincludes at least one of a haptic output, an auditory output, and avisual output.
 19. The smart glasses of claim 18, wherein thenotification includes at least one of information regarding and arecommendation regarding, the determined risk of harm from the inputsignal.
 20. The smart glasses of claim 1, further comprising a connectorto couple another device to the smart glasses and to communicate withthe device to receive an input from the coupled device, to output acontrol signal to the coupled device, or both.
 21. The smart glasses ofclaim 1, wherein the memory further contains information pertaining to aknown deficiency of the wearer's sensory faculties with regard to theinput signal, and the computer-executable instructions includeinstructions to process the input signal to determine if the deficiencyof the sensory faculties can be mitigated by modifying the outputsignal, and in the case it is determined the deficiency can bemitigated, the generated output signal is modified to mitigate thedeficiency.